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Ticket Insertion: Load Information For Assured Forwarding 



Classes 
By Maruthi Bhaskar 

5 Background Of The Invention 

1. Field of the Invention 

The present invention relates to networking technology. More specifically, the 
invention relates to methods and apparatuses for providing load information 
10 2, Description of the Related Art 

An enhancement to the Internet protocol is described in "Definition of the 
Differentiated Services Field (DS Field) in the IPv4 and Ipv6 Header" by Nichols et 
al.. Request for Comments 2474, "The Intemet Engineering Task Force of the Internet 
15 Society" 1998. The entire content of this document is incorporated herein by 
reference for all purposes. Differentiated services, as the name impUes, is a 
mechanism for providing different types of services to different data flows. For 
example, one flow may be assigned a larger bandwidth than another flow. 

Within the proposed differentiated services scheme there are two types of 
20 mechanisms for forwarding packets. The first type is referred to as expedited 
forwarding (EF). The service emulated by EF is analogous to having a leased line. 
The second type of forwarding is referred to as assured forwarding (AF). AF includes 
several relative levels of service. 



Attorney Docket No. CISCP127 



1 



Patent 



Each flow is classified into one of several AF classes. For example, the AF 
classes might include a gold, silver, and bronze class. Each AF class may also be 
associated with several loss probabihty levels. Each AF class and loss probabiUty 
level is forwarded in a different way. For example, flows for the gold class may have 
5 a larger bandwidth than flows for the silver class. 

Since it is impractical to classify packets at every router along the packet's 
transmission path {e.g., which path typically includes edge routers and core routers), 
classification is done by the edge routers. The edge routers typically handle less 
traffic than the core routers. The edge routers classify incoming packets into one of 
10 several predefined classes, hi other words, each packet is assigned to one behavior 
aggregate. 

After a packet is classified by an edge router and then routed to a core router, 
the receiving core routers then merely have to identify the packet as belonging to a 
particular behavior aggregate and apply the appropriate behavior for that aggregate. 
15 hi other words, the core router only has to determine the behavior aggregate that was 
previously assigned by the edge router. 

Resources are typically allocated statically for each class. For example, 
assume that the gold class is assigned a bandwidth usage of 10 Mbps, and the silver 
class is assigned a bandwidth usage of 5 Mbps. The problem with this scheme is that 
20 the actual service that a particular flow sees depends not only on the assigned AF 
class, but also on the current total load that the AF class is observing, hi the above 
described example, the gold class may have 10 streams that together are consuming 
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10 Mbps, and the silver class may have 1 stream that is by itself consuming 5 Mbps. 
Thus, the streams in the gold class each get 1 Mbps of bandwidth, while the silver 
stream gets 5 Mbps. Of course, each stream of the gold class should ideally be 
allocated more bandwidth than each stream of the silver class. However, due to the 
heavy load on the gold class, the streams of the gold class are temporarily short 
changed. 

In view of the foregoing, there is a need for improved methods and 
apparatuses for providing differentiated services. Specifically, there is a need to 
provide actual load information for each class so that resources may be more 
efficiently and rehably allocated to each class. 
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Summary Of The Invention 



Accordingly, the present invention provides an apparatus and method for 
providing load information for a particular service class. In general terms, load 
information is determined for each class. The load information is then sent to one or 
5 more destinations, and this load information is sent in the form of one or more tickets 
to the corresponding destination(s). The tickets for a particular destination or set of 
destinations represent the amount of load that is being received at such destination(s) 
on a per class basis. 

hi one embodiment, a method for providing load information for one or more 
10 data streams within a network having a plurality of ingress routers, a plurahty of core 
routers, and a plurahty of egress routers is disclosed. A plurality of packets is 
received into a selected ingress router. Each packet belongs to one of several service 
classes, and the packets are being transmitted to a particular destination. A load value 
is metered for each service class and the particular destination of at least one of the 
15 packets. One or more tickets are periodically transmitted to the destination to indicate 
the load value for each of the one or more service classes. 

In one embodiment, a router is disclosed for implementing the operation of 
this method. For example, the router is an ingress router. The router includes a 
memory and a processor coupled to the memory. At least one of the memory and the 
20 processor are adapted to provide the operations described above. In another 
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embodiment, the invention pertains to a computer readable medium containing 
programming instruction for implementing operations of this method. 

In another embodiment, a method for allocating resource to one or more data 
streams within a network having a plurality of ingress routers, a plurality of core 
5 routers, and a plurality of egress routers is disclosed. One or more tickets are received 
into a selected core router. The tickets indicate a total load for each one of a pluraUty 
of service classes. Resources are dynamically allocated to a plurality of streams 
within each service class based on the one or more received tickets. 

In one embodiment, a router is disclosed for implementing this method. For 
10 example, the router is a core router or an egress edge router. The router includes a 
memory and a processor coupled to the memory. At least one of the memory and the 
processor are adapted to provide the operations described above. In another 
embodiment, the invention pertains to a computer readable medium containing 
programming instruction for implementing this method. 

15 The present invention has several advantages. For example, once a router 

(e.g., a core router) acquires load information for the set of classes that it is servicing, 
the router can then dynamically allocate resources based on the provided load 
information. For example, the router can dynamically allocate resources for each 
stream of each class. In fact, the router can do whatever it wants with the provided 

20 load information, in addition to allocating resources. 
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These and other features and advantages of the present invention will be 
presented in more detail in the following specification of the invention and the 
accompanying figures which illustrate by way of example the principles of the 
invention. 
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Brief Description Of The Drawings 



The present invention will be readily understood by the following detailed 
description in conjunction with the accompanying drawings, wherein like reference 
nixmerals designate like structural elements, and in which: 

5 Figure 1 is a diagrammatic representation of a sub-network in accordance with 

one embodiment of the present invention. 

Figure 2 is a flowchart illustrating a process for tracking load in accordance 
with one embodiment of the present invention. 

Figure 3A is a flowchart illustrating the operation of Figure 2 for inserting 
10 tickets in accordance with one embodunent of the present invention. 

Figure 3B is a flowchart illustrating an alternative process for inserting tickets 
in accordance with an ahemative embodiment of the present invention. 

Figure 4 is a flowchart illustratmg a process for allocating resources in 
accordance with one embodiment of the present invention. 

15 Figure 5 is a diagrammatic representation of a router for implementing the 

process of Figures 3 and 4 in accordance with one embodiment of the present 
invention. 
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Detailed Description Of The Preferred Embodiments 



Reference will now be made in detail to the preferred embodiment of the 
invention. An example of the preferred embodiment is illustrated in the 
accompanying drawings. While the invention will be described in conjunction with 

5 that preferred embodiment, it will be understood that it is not intended to limit the 
invention to one preferred embodiment. On the contrary, it is intended to cover 
alternatives, modifications, and equivalents as may be included within the spirit and 
scope of the invention as defined by the appended claims, hi the following 
description, numerous specific details are set forth in order to provide a thorough 

10 understanding of the present invention. The present invention may be practiced 
without some or all of these specific details, hi other instances, well known process 
operations have not been described in detail in order not to unnecessarily obscure the 
present invention. 

Figure 1 is a diagrammatic representation of a sub-network 100 in accordance 
15 with one embodiment of the present invention. The sub-network 100 includes a 
plurality of edge routers (e.g., 104, 112, and 116). An edge router is defined as an 
ingress edge router when the edge router receives data streams from outside of the 
sub-network 100. As shown, data streams enter the sub-network 100 via ingress edge 
router 104. On the other hand, an edge router is defined as an egress edge router 
20 when data leaves the sub-network 100 through such edge router. As shown, the sub- 
network 100 includes a first egress edge router 112 and a second egress edge router 
116. Each egress edge router, as well as each ingress edge router, may be coupled to 
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another sub-network. As shown, egress edge router 116 is coupled to a network 1, 
while egress edge router 1 12 is coupled to a network 2. 

As data moves through network 100, it passes through one or more core 
routers. A core router generally receives data from an edge router or another core 
router within the same network and outputs data to another core router or to an edge 
router within the same network. As shown, core router 106 receives data from ingress 
edge router 104. The core router 106 then passes the data to core router 108. Core 
router 108 passes the data to either core router 1 14 or core router 110. Whether or not 
data is passed to core router 114 or core router 1 10 depends on the destination of the 
data. For example, data that is destined for network 1 will pass to core router 114, 
while data that is destined for network 2 will pass to core router 110. As shown, core 
router 114 then passes the data to edge router 116, which router then passes the data 
to network 1 . Likewise, core router 1 10 passes data to edge router 1 12, which router 
than passes the data to network 2. 

Each core router may include any number and kind of resources that are 
utiUzed to forward the packets towards their intended destinations. For example, each 
core router has a plurality of forwarding queues that may be utihzed to distinguish 
between classes, hi one embodiment, a first queue is used for a gold class; a second 
queue is used for a silver class; and a third queue is used for a bronze class. The 
packets from each queue may be forwarded by applying a round-robin scheduling. 
The nxmiber of packets that are selected from a particular queue during a particular 
round depends on the amount of bandwidth that is assigned to the corresponding 
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class. For example, three packets may be sent from the first class for the gold class; 
two packets sent for the second queue for the silver class; and one packet sent for the 
third queue for the bronze class. 

Conventionally, when a core router is simply provided with class information 
5 for a given stream (e.g., the identity of the class to which the stream belongs), the core 
router has limited capabilities for managing load between resources. In the above 
example, if the bronze class has 1 stream and the gold class had 10 streams coming 
into a particular core router, the single stream of the bronze class ends up with more 
bandwidth than the streams of the gold class. 

10 The present invention provides mechanisms for determining load information 

the number of streams) for each class that is being received by a particular core 
router or group of core routers. The core router(s) may utilize this load information to 
calculate new bandwidth assignments on a per stream basis, for example. That is, the 
core router may be able to dynamically allocate bandwidth for each stream within 

15 each class. The resource allocation can be based on the actual load being utihzed by 
the streams of a given class. An example of such a resource allocation scheme is 
described below with reference to Figure 4. 

Any suitable mechanisms may be utilized for providing load information to 
the core routers. In a preferred embodiment, tickets that indicate load information are 
20 sent to each core router or a set of core routers. The tickets may contain any suitable 
information that a core router may utilize to allocate resources to each stream within a 
particular class. In one embodiment, each ticket represents a unit of load {e.g., a 
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stream) for a particular class. Thus, the core router may coxmt the number of tickets 
to determine the amount of load for a particular class, hi an altemative embodiment, 
each ticket may represent any amount of load (e,g„ the total number of streams) for a 
particular class. 

The ticket(s) may be sent to any suitable destination that may utilize the load 
information contained in the ticket(s). For example, the tickets are sent to the same 
destination as the stream(s) that are being represented by the tickets. Alternatively, 
the tickets are sent to a destination aggregate or a group of core routers. One example 
of a destination aggregate is an egress router. Although a packet may move through 
several core routers, the packet typically only passes through a single egress router. If 
load information that is relevant for a particular egress router is sent to such egress 
router, the load information will also be received by the core router that is responsible 
for handling such load (e.^., this core router forwards the corresponding load or 
streams to such egress router). The core router may utihze the load information to 
determine the number of packets, for example, from each stream to send to a 
particular egress router. 

Figure 2 is a flowchart 200 illustratmg a process for tracking load in 
accordance with one embodiment of the present invention, hi operation 202, packets 
are received into an ingress router. Tickets to indicate load for each stream or a set of 
streams are then inserted in operation 204. Although shown as a linear process, 
packets may be continually received by ingress router and tickets may be continually 
inserted for the received packets. 
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Packets and tickets may then be received at a core router in operation 206. 
The core router then calculates load for each relevant class based on the received 
tickets in operation 208. The core router may utiUze the inserted ticket in any suitable 
manner. For example, the core router may utilize the tickets to calculate the load for 
5 each relevant class, as indicated in operation 208. Altematively, the core router may 
utihze the inserted tickets to calculate load for any suitable sub-set of classes. 

In the illustrated embodiment, the core router then assigns resources to each 
class based on the calculated load in operation 210. Assignments may be performed 
in any suitable manner. For example, a particular bandwidth may be assigned to each 

10 stream within a given class. The streams of each class may have different bandwidth 
assignments. For example, each stream of the gold class may be allocated 5 
megabytes per second, while each stream of the silver class may be allocated 3 
megabytes per second. Any extra bandwidth may then be divided amongst the 
streams within each class. One embodiment of a resource allocation process is 

1 5 described below with reference to Figure 4. 

Tickets may be inserted in any suitable manner that provides relevant load 
information to the core routers. Figure 3A is a flowchart illustrating the operation 
204 of Figure 2 for inserting tickets in accordance with one embodiment of the 
present invention. Initially, packets are received in operation 302. The load for each 
20 class and each destination is then metered in operation 304. Any suitable metering 
algorithm may be utilized. 
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It is then determined whether it is time to send a ticket in operation 306. 
Tickets may be sent after a predetermined time period or sent when the metered load 
for a particular class or a particular destination changes (as described below with 
reference to Figure 3B). Any suitable factors may be utiUzed to determine when to 
5 send a ticket. For example, tickets should be sent at least as frequently as the core 
routers that utilize load information require updated load information. Additionally, 
the number of tickets may be limited to a number that will not tax or overwhehn the 
processing resources of a core router. 

If it not time to send a packet, packets continue to be received in operation 
10 302. If it is time to send a ticket, one or more tickets indicating load and class are 
then sent to the destination address of the corresponding load in operations 308. For 
example, a ticket is sent for each unit of load that reaches a particular destination. In 
one embodiment, one ticket is sent to the destination address of each stream. Each 
ticket also indicates the class that is associated with such stream. 

15 Figure 3B is a flowchart illustrating an alternative process 204' for inserting 

tickets in accordance with an alternative embodiment of the present invention, 
hiitially, packets are received in operation 352. The load is then measured for each 
destination aggregate in operation 354. A destination aggregate is generally defined 
as a set of destinations, such as network 1 of Figure 1. In this embodiment, the load 

20 merely has to be calculated for each destination aggregate, as compared to calculating 
the load for each stream destination. Of course, this process 204' may not be as 
accurate as the previously described process 204 of Figure 3 A. 
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It is then determined whether the load has changed for any of the destination 
aggregates in operation 356. For example, the niimber of streams to a particular 
destination aggregate and class has either decreased or increased since tickets were 
last sent for such class and destination aggregate. If there is a change via 358, a ticket 
indicating the load of the corresponding class is sent to the corresponding destination 
aggregate that has a changed load in operations 360. If there is not a change in the 
load values of a destination aggregate, packets continue to be received in operation 
352. 

The destination aggregate for a particular stream may be determined in any 
suitable manner. For example, a Border Gateway Protocol (BGP) route aggregate for 
a particular stream may be defined as the destination aggregate for that stream. 
Alternatively, a routing table may be compiled that matches the destination address of 
a particular stream with a destination aggregate, such as an egress edge router. More 
specifically, a concept referred to as "symmetry" is utilized to populate the routing 
table. When a packet of a particular stream is transmitted to a particular egress router, 
for example, a response fi*om such egress router is typically sent back to the ingress 
router through which the stream origmally entered the sub-network. Thus, the source 
address (e.g., destination aggregate or egress router address) of such response may be 
obtained and matched with the destination address of the particular stream. 

In one embodiment, the processes for inserting a ticket (e.g., process 204 and 
204' of Figures 3 A and 3B) may be implemented by an ingress edge router. Of 
course, these processes may be implemented on any suitable router or processing node 
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that observes load information for particular destination(s) and classes. Preferably, 
the number of streams flowing through such router is minimal, as compared to other 
routers, such that load calculation processing is minimized at the particular router. In 
the embodiment of Figure 1, the ingress router 104 may be configured to calculate 
load for a class and destination (e.g., egress router 116 and 112) and then to send 
tickets to indicate such load to the corresponding destination (e.g., egress router 116 
or 112). 

Once a destination or destination aggregate receives load information for one 
or more classes, the destination or destination aggregate may then proceed to utiUze 
this load information in any suitable manner. Li the illustrated embodiment of Figure 
1 , for each round the core router 108 may send a first amount of packets to core router 
114 and a second amount of packets to core router 110 based on the amount of load 
flowing through core routers 114 and 110, as well as the assigned load. That is, 
packets that flow through core router 1 14 may belong to the gold class, while packets 
that flow through core router 110 belong to the bronze class. Thus, a higher number 
of packets for each stream are sent to core router 1 14 than to core router 110. 

Figure 4 is a flowchart illustrating a process 400 for allocating resources in 
accordance with one embodiment of the present invention. Initially, packets and 
tickets are received for a plurality of streams and a plurality of classes in operation 
402. The number of streams are identified for each class based on the nimiber of 
tickets received per class in operation 404. 
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A predetermined resource allocation value is obtained for each class and each 
stream in operation 406. hi other words, each class may have a particular bandwidth 
assigned for each of its streams. For example, the gold class is initially allowed to 
transmit 5 packets per stream per roimd; the silver class is initially allowed to transmit 
5 3 packets per stream per round; and the bronze class is initially allowed to transmit 2 
packets per stream per round. 

A controlled resource allocation value is then calculated per class in operation 
408. For example, the predetermined resource allocation for a class is multiplied by 
the number of streams within that class. The resource remainder is then calculated its 
10 operation 410. The resource remainder is equal to the total available bandwidth 
minus the total control resource allocation for all of the classes. The resource 
remainder may then be distributed among the streams in each class in operation 412. 

hi the above example, let's suppose that the gold class currently has 3 streams; 
the silver class has 2 streams; and the bronze stream has 1 stream. The gold, silver, 

15 and bronze classes are initially allocated 5, 3, and 2 packets per stream per round, 
respectively. Thus, the total controlled resource allocation is 23 (3 gold streams x 5 
packets + 2 silver streams x 3 + 1 bronze stream x 2). If the total available resources 
for each round is 50 packets, the remainder is 27 packets (50 - 23 = 27). The 
remainder of 27 packets may then be proportionately allocated among the streams 

20 within each class. For example, the gold class gets to transmit an extra 17 packets (15 
/ (15 + 6 + 2) X 27 = 17). That is, the total number of resources allocated to the gold 
stream (15) is divided by the sum of the resources allocated to all of the classes (15 + 
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6 + 2). The result represents the proportion of the total resources that are allocated to 
the gold class. This ratio (15) is multiphed with the remainder resources (27) to 
determine what portion of the remainder is to be allocated to the gold class, hi other 
words, each class gets a fraction of the remainder, and that fraction is based on the 
5 proportion of resources that are initially being utiUzed by such class. 

Generally, the techniques of the present invention for providing load 
information may be implemented on software and/or hardware. For example, they 
can be implemented in an operating system kernel, in a separate user process, in a 
library package bound into network apphcations, on a specially constructed machine, 
10 or on a network interface card. In a specific embodiment of this invention, the 
techniques of the present invention are implemented in software such as an operating 
system or in an application running on an operating system. 

A software or software/hardware hybrid load calculation system of this 
invention is preferably implemented on a general-purpose programmable machine 

1 5 selectively activated or reconfigured by a computer program stored in memory. Such 
programmable machine may be a network device designed to handle network traffic. 
Such network devices typically have multiple network interfaces including frame 
relay and ISDN interfaces, for example. Specific examples of such network devices 
include routers and switches. For example, the load calculation systems of this 

20 invention may be specially configured routers such as specially configured router 
models 1600, 2500, 2600, 3600, 4500, 4700, 7200, 7500, and 12000 available from 
Cisco Systems, Inc. of San Jose, CaUfomia. A general architecture for some of these 
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machines will appear from the description given below. hi an alternative 
embodiment, the load calculation system may be implemented on a general-purpose 
network host machine such as a personal computer or workstation. Further, the 
invention may be at least partially implemented on a card (e.g., an interface card) for a 
network device or a general-purpose computing device. 

Referring now to Figure 5, a router 10 suitable for implementing the present 
invention includes a master central processing unit (CPU) 62, interfaces 68, and a bus 
15 (e.g., a PCI bus). When acting under the control of appropriate software or 
firmware, the CPU 62 is responsible for such router tasks as routing table 
computations and network management. It may also be responsible for calculating 
load for each class and destination aggregate, sending one or more tickets to such 
destination aggregate, etc. It preferably accompUshes all these functions under the 
control of software including an operating system (e.g., the hitemetwork Operating 
System (lOS®) of Cisco Systems, Inc.) and any appropriate apphcations software. 
CPU 62 may include one or more processors 63 such as a processor from the 
Motorola family of microprocessors or the MIPS family of microprocessors, hi an 
alternative embodiment, processor 63 is specially designed hardware for controlling 
the operations of router 10. hi a specific embodiment, a memory 61 (such as non- 
volatile RAM and/or ROM) also forms part of CPU 62. However, there are many 
different ways in which memory could be coupled to the system. Memory block 61 
may be used for a variety of purposes such as, for example, caching and/or storing 
data, programming instructions, etc. 
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The interfaces 68 are typically provided as interface cards (sometimes referred 
to as "line cards"). Generally, they control the sending and receiving of data packets 
over the network and sometimes support other peripherals used with the router 10. 
Among the interfaces that may be provided are Ethernet interfaces, frame relay 
interfaces, cable interfaces, DSL interfaces, token ring interfaces, and the like. In 
addition, various very high-speed interfaces may be provided such as fast Ethernet 
interfaces, Gigabit Ethernet interfaces, ATM interfaces, HSSI interfaces, POS 
interfaces, FDDI interfaces and the like. Generally, these interfaces may include ports 
appropriate for communication with the appropriate media. In some cases, they may 
also include an independent processor and, in some instances, volatile RAM. The 
independent processors may control such communications intensive tasks as packet 
switching, media control and management. By providing separate processors for the 
coramunications intensive tasks, these interfaces allow the master microprocessor 62 
to efficiently perform routing computations, network diagnostics, security functions, 
etc. 

Although the system shown in Figure 5 is one specific router of the present 
invention, it is by no means the only router architecture on which the present 
invention can be implemented. For example, an architecture having a single 
processor that handles communications as well as routing computations, etc. is often 
used. Further, other types of interfaces and media could also be used with the router. 

Regardless of network device's configuration, it may employ one or more 
memories or memory modules (such as, for example, memory block 65) configured to 
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store data, program instructions for the general-purpose network operations and/or 
calculate load information and send tickets described herein. The program 
instructions may control the operation of an operating system and/or one or more 
applications, for example. The memory or memories may also be configured to store 
the load counts for each class and destination, and the tickets, etc. 

Because such information and program instructions may be employed to 
implement the systems/methods described herein, the present invention relates to 
machine readable media that include program instructions, state information, etc. for 
performing various operations described herein. Examples of machine-readable 
media include, but are not limited to, magnetic media such as hard disks, floppy disks, 
and magnetic tape; optical media such as CD-ROM disks; magneto-optical media 
such as floptical disks; and hardware devices that are specially configured to store and 
perform program instructions, such as read-only memory devices (ROM) and random 
access memory (RAM). The invention may also be embodied in a carrier wave 
travelling over an appropriate medium such as airwaves, optical lines, electric lines, 
etc. Examples of program instructions include both machine code, such as produced 
by a compiler, and files containing higher level code that may be executed by the 
computer using aa interpreter. 

Although the foregoing invention has been described in some detail for 
purposes of clarity of understanding, it will be apparent that certain changes and 
modifications may be practiced within the scope of the appended claims. It should be 
noted that there are many altemative ways of implementing both the process and 
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apparatus of the present invention. Accordingly, the present embodiments are to be 
considered as illustrative and not restrictive, and the invention is not to be limited to 
the details given herein, but may be modified within the scope and equivalents of the 
appended claims. 
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CLAIMS 



WHAT IS CLAIMED IS: 




A method for providing load information for one or more data streams 



within a network having a pluraUty of ingress routers, a plurahty of core routers, and a 
5 plurahty of egress routers, the method comprising: 

receiving a plurality of packets into a selected ingress router, each packet 
belonging to a selected one of a plurality of service classes and the packets being 
transmitted to a particular destination; 

metering a load value for each service class and the particular destination of at 
1 0 least one of the packets; and 

periodically transmitting one or more tickets to the destination to indicate the 
load value for each of the one or more service classes. 

2. A method as recited in claim 1, wherein the destination is a selected 
one of the egress routers. 

15 3. A method as recited in claim 1 wherein the one or more tickets 

indicate a total number of streams for each class that is being transmitted to the 
destination. 

4. A method as recited in claim 3, wherein each ticket indicates a total 
number of streams for a particular class that are being transmitted to the destination. 
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5. A method as recited in claim 3 wherein each ticket indicates a single 
stream for a particular class that is being transmitted to the destination. 

6. A method as recited in claim 3, wherein the tickets and the streams 
represented by the tickets are being transmitted to the same destination. 

5 7. A method as recited in claim 1, wherein one or more tickets are only 

transmitted for a particular class when the load value has changed for such service 
class. 

8. A method as recited in claim 1 wherein one or more tickets are 
transmitted after a predetermined amount of time. 

[0 9. A method as recited in claim 1 wherein the one or more tickets are sent 

to a selected core router and configured to allow the selected core router to 
dynamically allocate resources based on the current load of each class. 

10. A method as recited in claim 9 wherein the tickets facilitate assured 
forward routing and differentiated services performed by the core router. 

15 j/f^ K router for providing load information for one or more data streams 

within a network having a plurality of ingress routers, a plurality of core routers, and a 
plurality of egress routers, the router comprising: 
a memory; and 

a processor coupled to the memory, 
20 wherein at least one of the memory and the processor are adapted to provide: 
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receiving a plurality of packets, each packet belonging to a selected 
one of a plxirality of service classes and the packets being transmitted to a 
particular destination; 

metering a load value for each service class and the particular 
5 destination of at least one of the packets; and 

periodically transmitting one or more tickets to the destination to 
indicate the load value for each of the one or more service classes. 

12. A router as recited in claim 11, wherein the destination is a selected 
one of the egress routers. 

10 13. A router as recited in claim 1 1 wherein the one or more tickets indicate 

a total number of streams for each class that is being transmitted to the destination. 

14. A router as recited in claim 13, wherein each ticket indicates a total 
number of streams for a particular class that are being transmitted to the destination. 

15. A router as recited in claim 13 wherein each ticket indicates a single 
1 5 stream for a particular class that is being transmitted to the destination. 

16. A router as recited in claim 13, wherein the tickets and the streams 
represented by the tickets are being transmitted to the same destination. 

17. A method as recited in claim 11, wherein one or more tickets are only 
transmitted for a particular class when the load value has changed for such service 

20 class. 
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18. A method as recited in claim 11 wherein one or more tickets are 
transmitted after a predetermined amount of time. 

19. A method as recited in claim 11 wherein the one or more tickets are 
sent to a selected core router and configured to allow the selected core router to 

5 dynamically allocate resources based on the current load of each class. 

20. A method as recited in claim 19 wherein the tickets facilitate assured 
forward routing and differentiated services performed by the core router. 



^\ . A computer readable medium containing programming instructions for 
providing load information for one or more data streams within a network having a 
1 0 plurality of ingress routers, a plurality of core routers, and a plurality of egress routers, 
the computer readable medium comprising: 

computer code for receiving a plurality of packets into a selected ingress 
router, each packet belonging to a selected one of a plurality of service classes and the 
packets being transmitted to a particular destination; 
15 computer code for metering a load value for each service class and the 

particular destination of at least one of the packets; and 

computer code for periodically transmitting one or more tickets to the 
destination to indicate the load value for each of the one or more service classes. 



20 network having a plurality of ingress routers, a plurality of core routers, and a 
plurality of egress routers, the method comprising: 





A method for allocating resource to one or more data streams within a 
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receiving one or more tickets into a selected core router, the tickets indicating 
a total load for each one of a plurality of service classes; and 

dynamically allocating resources to a plurality of streams within each service 
class based on the one or more received tickets. 

23. A method as recited in claim 22, wherein the tickets indicate a total 
number of streams being transmitted to the selected core router for each class. 

24. A method as recited in claim 22, wherein the resources are allocated 

by: 

calculating a total controlled resource allocation per class; 
calculating a resource remainder; and 

allocating the resource remainder to the streams of each class based on the 
calculated total controlled resource allocation for the each class. 

25. A method as recited in claim 24, wherein the total controlled resource 
allocation for a particular class is equal to an assigned resource allocation for each 
stream within the particular class times a total number of streams within the particular 
class and the resource remainder is equal to a total available bandwidth minus the 
total controlled resource allocation for all of the classes. 

26. A method as recited in claim 24, wherein a portion of the resource 
remainder is allocated to a particular class and the portion is proportionate to a ratio 
of the total controlled resource allocation for the particular class divided by the total 
controlled resource allocation for all classes. 
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A router for allocating resource to one or more data streams within a 
network having a plurality of ingress routers, a plurahty of core routers, and a 
plurality of egress routers, the router comprising: 
a memory; and 

a processor coupled to the memory, 

wherein at least one of the memory and the processor are adapted to provide: 

receiving one or more tickets into the router, the tickets indicating a 

total load for each one of a plurality of service classes; and 

dynamically allocating resources to a plurahty of streams within each 

service class based on the one or more received tickets. 

A computer readable medium containing programming instructions for 
allocating resource to one or more data streams within a network having a plurality of 
ingress routers, a plurality of core routers, and a plurality of egress routers, the 
computer readable medium comprising: 

computer code for receiving one or more tickets into a selected core router, the 
tickets indicating a total load for each one of a plurahty of service classes; and 

computer code for dynamically allocating resources to a plurahty of streams 
within each service class based on the one or more received tickets. 
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Ticket Insertion: Load Information For Assured Forwarding 

Classes 

Abstract of the Disclosure 

Disclosed are methods and apparatus for providing load information for one or 
more data streams within a network having a plurality of ingress routers, a plurality of 
core routers, and a plurality of egress routers is disclosed, a plurality of packets are 
received into a selected ingress router. Each packet belongs to one of several service 
classes, and the packets are being transmitted to a particular destination. A load value 
is metered for each service class and the particular destination of at least one of the 
packets. One or more tickets are periodically transmitted to the destination to indicate 
the load value for each of the one or more service classes. This load information is 
then utilized to dynamically allocate load for each service class at the destination. 
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As a below-named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name. 

I believe that I am the original, first and sole inventor (if only one name is listed below) or an original, first and joint inventor (if 
plural names are listed below) of the subject matter which is claimed and for which a patent is sought on the invention entitled: 
Ticket Insertion: Load Information for Assured Forwarding Classes , the specification of which, 

(check one) 1 . ^ is attached hereto. 

2. CZ] was filed on . as 

U.S. Application No. 

and was amended on . 

I 3. n was filed on as 

I International PCX Application No. „ 

~ and was amended on * 

II hereby state that I have reviewed and understand the contents of the above-identified specification, including the claims, as 
] amended by any amendment referred to above. 

1l acknowledge the duty to disclose information which is material to the examination of this application in accordance with Title 
"37, CFR§ 1.56. 

"I Prior Foreign Application(s) 

hereby claim foreign priority benefits under Title 35, United States code, § 1 19(a)-(d) or § 365(b) of any foreign application(s) 
J for patent or inventor's certificate, or § 365(a) of any PCT International application which designated at least one country other 
Ithan the United States, hsted below and have identified below, by checkmg the box, any foreign application for patent or 
1 inventor's certificate, or PCT International application having a filing date before that of the application on which priority is 
claimed: 
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(Application No.) (Country) (Filing Date) 
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(Application No.) (Country) (Filing Date) 

Provisional Application(s) 
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I hereby claim the benefit under Title 35, United States Code, § 120 of any United States application(s), or § 365(c) of any PCT 
International application designating the United States, listed below and, insofar as the subject matter of each of the claims of this 
application is not disclosed in the prior United States or PCT International application in the manner provided by the first 
paragraph of Title 35, United States Code, § 112, I acknowledge the duty to disclose information which is material to 
patentability as defined in Title 37, Code of Federal Regulations, § 1.56 which became available between the filing date of the 
prior application and the national or PCT international filing date of this application: 



(Apphcation No.) (Filing Date) (Status - patented, pending, abandoned) 



(Application No.) (Filing Date) (Status - patented, pending, abandoned) 
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And I hereby appoint the law firm of Beyer & Weaver, LLP and all practitioners who are associated with the Customer Number 
022434 as my principal attorneys to prosecute this application and to transact all business in the Patent and Trademark Office 
connected therewith. 



I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information and 
belief are believed to be true; and further that these statements were made with the knowledge that willful false statements and the 
i 5 like so made are punishable by fine or imprisoimaent, or both, under section 1001 of Title 18 of the United States Code, and that 
Ssuch willful false statements may jeopardize the vahdity of the application or any patent issuing thereon. 
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